Method of processing content and electronic device thereof

ABSTRACT

A method for processing contents at an electronic device is provided. The method includes generating a first content corresponding to a user input applied to content via the electronic device, and displaying a floating user interface (UI), which displays first scrap information on the first content, on a screen of the electronic device.

CROSS-REFERENCE TO RELATED APPLICATION(S)

This application claims the benefit under 35 U.S.C. §119 (a) of a Koreanpatent application filed on Sep. 2, 2014 in the Korean IntellectualProperty Office and assigned Serial number 10-2014-0116514, the entiredisclosure of which is hereby incorporated by reference.

TECHNICAL FIELD

The present disclosure relates to an electronic device for processingcontent.

BACKGROUND

Based on development of information communication technologies andsemiconductor technologies, the supply and use of various portableterminals has rapidly increased. Particularly, recent portable terminalsinclude various functions such as a television (TV) viewing function(for example, mobile broadcasting such as digital multimediabroadcasting (DMB) or digital video broadcasting (DVB)), an audioplayback function (for example, Moving Picture Experts Group phase 1 orphase 2 (MPEG-1 or MPEG-2) audio layer-3 (MP3)), a picture function, anda data communication function, and audio an communication function suchas voice calling or message transmission/reception.

The above information is presented as background information only toassist with an understanding of the present disclosure. No determinationhas been made, and no assertion is made, as to whether any of the abovemight be applicable as prior art with regard to the present disclosure.

SUMMARY

Aspects of the present disclosure are to address at least theabove-mentioned problems and/or disadvantages and to provide at leastthe advantages described below. Accordingly, an aspect of the presentdisclosure is to provide a method and an electronic device for allowingthe user to easily use the memo function or the scrap function.

A user executes many steps to perform a memo function or scrap functionof the related art, and thus, the user cannot easily use the memofunction or the scrap function.

In accordance with an aspect of the present disclosure, a method forprocessing a content at an electronic device is provided. The methodincludes generating a first content corresponding to a user inputapplied to content displayed via the electronic device, and displaying afloating user interface (UI), which displays first scrap information onthe first content, on a screen of the electronic device.

In accordance with another aspect of the present disclosure, anelectronic device for processing a content is provided. The electronicdevice includes a display and a processor configured to generate a firstcontent corresponding to a user input applied to content displayed viathe display, and control the display to display a floating UI, whichdisplays first scrap information on the first content, on a screen.

In accordance with another aspect of the present disclosure, amachine-readable storage medium recording a program for executing amethod of processing a content by an electronic device is provided. Themethod includes generating a first content corresponding to a user inputcontent displayed via the electronic device, and displaying a floatingUI, which displays first scrap information on the first content, on ascreen of the electronic device.

The present disclosure can provide a method and an electronic device forallowing the user to easily use a memo function or a scrap function,

Other aspects, advantages, and salient features of the disclosure willbecome apparent to those skilled in the art from the following detaileddescription, which, taken in conjunction with the annexed drawings,discloses various embodiments of the present disclosure.

BRIEF DESCRIPTION OF THE DRAWINGS

The above and other aspects, features, and advantages of certainembodiments of the present disclosure will be more apparent from thefollowing description taken in conjunction with the accompanyingdrawings, in which:

FIG. 1 illustrates a network environment including an electronic deviceaccording to various embodiments of the present disclosure;

FIG. 2 is a flowchart of a method of processing contents by anelectronic device according to various embodiments of the presentdisclosure;

FIG. 3 is a flowchart of another method of processing the contents bythe electronic device according to various embodiments of the presentdisclosure;

FIGS. 4A, 4B, 4C, 4D, and 4E illustrate an example of processingcontents by the electronic device according to various embodiments ofthe present disclosure;

FIGS. 5A, 5B, 5C, and 6D illustrate an example of processing contents bythe electronic device according to various embodiments of the presentdisclosure;

FIGS. 6A, 6B, 6C, and 6D illustrate an example of selecting contentsaccording to a user input by the electronic device according to variousembodiments of the present disclosure;

FIGS. 7A, 7B, 7C, and 7D illustrate another example of processingcontents by the electronic device according to various embodiments ofthe present disclosure;

FIGS. 8A and 8B illustrate another example of processing contents by theelectronic device according to various embodiments of the presentdisclosure;

FIG. 9 illustrates another example of processing contents by theelectronic device according to various embodiments of the presentdisclosure;

FIGS. 10A, 10B, 10C, 10D, 10E, 10F, 10G, and 10H illustrate anotherexample of processing contents by the electronic device according tovarious embodiments of the present disclosure;

FIGS. 11A, 11B, 11C, and 11D illustrate another example of processingcontents by the electronic device according to various embodiments ofthe present disclosure;

FIGS. 12A and 12B illustrate another example of processing contents bythe electronic device according to various embodiments of the presentdisclosure;

FIGS. 13A, 13B, and 13C illustrate another example of processingcontents by the electronic device according to various embodiments ofthe present disclosure;

FIGS. 14A and 14B illustrate another example of processing contents bythe electronic device according to various embodiments of the presentdisclosure;

FIGS. 15A, 15B, 15C and 15D illustrate another example of processingcontents by the electronic device according to various embodiments ofthe present disclosure;

FIG. 16 illustrates another example of processing contents by theelectronic device according to various embodiments of the presentdisclosure;

FIG. 17 illustrates another example of processing contents by theelectronic device according to various embodiments of the presentdisclosure;

FIGS. 18A and 18B illustrate another example of processing contents bythe electronic device according to various embodiments of the presentdisclosure;

FIGS. 19A, 19B, and 19C illustrate another example of processingcontents by the electronic device according to various embodiments ofthe present disclosure;

FIG. 20 is a block diagram of an electronic device according to variousembodiments of the present disclosure; and

FIG. 21 is a block diagram of a program module according to variousembodiments of the present disclosure.

Throughout the drawings, like reference numerals will be understood torefer to like parts, components, and structures.

DETAILED DESCRIPTION

The following description with reference to the accompanying drawings isprovided to assist in a comprehensive understanding of variousembodiments of the present disclosure as defined by the claims and theirequivalents. It includes various specific details to assist in thatunderstanding but these are to be regarded as merely exemplary.Accordingly, those of ordinary skill in the art will recognize thatvarious changes and modifications of the various embodiments describedherein can be made without departing from the scope and spirit of thepresent disclosure. In addition, descriptions of well-known functionsand constructions may be omitted for clarity and conciseness.

The terms and words used in the following description and claims are notlimited to the bibliographical meanings, but, are merely used by theinventor to enable a clear and consistent understanding of the presentdisclosure. Accordingly, it should be apparent to those skilled in theart that the following description of various embodiments of the presentdisclosure is provided for illustration purpose only and not for thepurpose of limiting the present disclosure as defined by the appendedclaims and their equivalents.

It is to be understood that the singular forms “a,” “an,” and “the”include plural references unless the context clearly dictates otherwise.Thus, for example, reference to “a component surface” includes referenceto one or more of such surfaces.

In the present disclosure, the expression “have”, “may have”, “include”or “may include” refers to existence of a corresponding feature (e.g.,numerical value, function, operation, or components such as elements),and does not exclude existence of additional features.

Throughout the present disclosure the words “comprise” and “contain” andvariations of the words, for example “comprising” and “comprises”, means“including but not limited to”, and is not intended to (and does not)exclude other moieties, additives, components, integers or steps.

In the present disclosure, the expression “A or B”, “at least one of Aor/and B”, or “one or more of A or/and B” may include all possiblecombinations of the items listed. For example, the expression “A or B”,“at least one of A and B”, or “at least one of A or B” refers to all of(1) including at least one A, (2) including at least one B, or (3)including all of at least one A and at least one B.

The expression “a first”, “a second”, “the first”, or “the second” usedin various embodiments of the present disclosure may modify variouscomponents regardless of the order and/or the importance but does notlimit the corresponding components. The expressions may be used todistinguish a component element from another component element. Forexample, a first user device and a second user device indicate differentuser devices although both of them are user devices. For example, afirst element may be termed a second element, and similarly, a secondelement may be termed a first element without departing from the scopeof the present disclosure.

When one element (e.g., a first element) is “(operatively orcommunicatively) coupled with/to or connected to” another element (e.g.,a second element), it should be construed that the one element isdirectly connected to another element or the one element is indirectlyconnected to another element via yet another element (e.g., a thirdelement). Conversely, when one component element is “directly coupled”or “directly connected” to another component element, it may beconstrued that a third component element does not exist between thefirst component element and the second component element.

The expression “configured to” used in the present disclosure may beexchanged with, for example, “suitable for”, “having the capacity to”,“designed to”, “adapted to”, “made to”, or “capable or according to thesituation. The term “configured to” may not necessarily imply“specifically designed to” in hardware. Alternatively, in somesituations, the expression “device configured to” may mean that thedevice, together with other devices or components, “is able to”. Forexample, the phrase “processor adapted (or configured) to perform A, B,and C” may mean a dedicated processor (e.g. embedded processor) only forperforming the corresponding operations or a generic-purpose processor(e.g., central processing unit (CPU) or application processor (AP)) thatcan perform the corresponding operations by executing one or moresoftware programs stored in a memory device.

Features, integers, characteristics, compounds, chemical moieties orgroups described in conjunction with a particular aspect, embodiment orexample of the disclosure are to be understood to be applicable to anyother aspect, embodiment or example described herein unless incompatibletherewith.

The terms used herein are merely for the purpose of describingparticular embodiments and are not intended to limit the scope of otherembodiments. As used herein, singular forms may include plural forms aswell unless the context clearly indicates otherwise. Unless definedotherwise, all terms used herein, including technical and scientificterms, have the same meaning as those commonly understood by a personskilled in the art to which the present disclosure pertains. Such termsas those defined in a generally used dictionary are to be interpreted tohave the meanings equal to the contextual meanings in the relevant fieldof the art, and are not to be interpreted to have ideal or excessivelyformal meanings unless clearly defined in the present disclosure. Insome cases, even the term defined in the present disclosure should notbe interpreted to exclude embodiments of the present disclosure.

For example, the electronic device may include at least one of asmartphone, a tablet personal computer (PC), a mobile phone, a videophone, an electronic book (e-book) reader, a desktop PC, a laptop PC, anetbook computer, a personal digital assistant (PDA), a portablemultimedia player (PMP), an MP3 player, a mobile medical appliance, acamera, and a wearable device (e.g., a head-mounted-device (HMD) such aselectronic glasses, electronic clothes, an electronic bracelet, anelectronic necklace, an electronic appcessory, electronic tattoos, or asmart watch).

According to various embodiments, the electronic device may be a smarthome appliance. The home appliance may include at least one of, forexample, a television, a digital video disk (DVD) player, an audio, arefrigerator, an air conditioner, a vacuum cleaner, an oven, a microwaveoven, a washing machine, an air cleaner, a set-top box, a homeautomation control panel, a security control panel, a TV box (e.g.,Samsung HomeSync™, Apple TV™, or Google TV™), a game console (e.g.,Xbox™ and PlayStation™),an electronic dictionary, an electronic key, acamcorder, and an electronic photo frame.

According to another embodiment, the electronic device may include atleast one of various medical devices (e.g., various portable medicalmeasuring devices (a blood glucose monitoring device, a heart ratemonitoring device, a blood pressure measuring device, a body temperaturemeasuring device, etc.), a magnetic resonance angiography (MRA), amagnetic resonance imaging (MRI), a computed tomography (CT) machine,and an ultrasonic machine), a navigation device, a global positioningsystem (GPS) receiver, an event data recorder (EDR) , a flight datarecorder (FDR) , a vehicle infotainment device, an electronic devicesfor a ship (e.g., a navigation device for a ship, and a gyro-compass),avionics, security devices, an automotive head unit, a robot for home orindustry, an automatic teller's machine (ATM), a point of sales (POS) ina shop, or internet device of things (e.g., a light bulb, varioussensors, electric or gas meter, a sprinkler device, a fire alarm, athermostat, a streetlamp, a toaster, a sporting goods, a hot water tank,a heater, a boiler, etc.).

According to various embodiments, the electronic device may include atleast one of a part of furniture or a building/structure, an electronicboard, an electronic signature receiving device, a projector, andvarious kinds of measuring instruments (e.g., a water meter, an electricmeter, a gas meter, and a radio wave meter). The electronic deviceaccording to various embodiments of the present disclosure may be acombination of one or more of the aforementioned various devices. Theelectronic device according to various embodiments of the presentdisclosure may be a flexible device. Further, the electronic deviceaccording to an embodiment of the present disclosure is not limited tothe aforementioned devices, and may include a new electronic deviceaccording to the development of technology.

Hereinafter, an electronic device according to various embodiments ofthe present disclosure will be described with reference to theaccompanying drawings. As used herein, the term “user” may indicate aperson who uses an electronic device or a device (e.g., an artificialintelligence electronic device, an automated device for performingtesting operations, etc.) that uses an electronic device.

FIG. 1 illustrates a network environment including an electronic deviceaccording to various embodiments of the present disclosure.

Referring to FIG. 1, a network environment 100 includes an electronicdevice 101. The electronic device 101 may include a bus 110, a processor120, a memory 130, an input/output interface 150, a display 160, and acommunication interface 170. According to various embodiments, theelectronic device 101 may omit at least some of the above components orfurther include other components.

The bus 110 may include a circuit for connecting the components 120 to170 and transmitting communication between the components (for example,control messages and/or data).

The processor 120 may include one or more of a CPU, an AP, and acommunication processor (CP). For example, the processor 120 may carryout operations or data processing related to control and/orcommunication of at least one other component of the electronic device101.

The processor 120 may control the electronic device 101 to perform amemo function or a scrap function. According to an embodiment, theelectronic device 101 may execute a scrap mode for storing ortemporarily storing data, for example, text or image selected by theuser. Further, the processor 120 may control the electronic device 101to inform the user that a stored or temporarily stored content exist bycontrolling the display 160 to display a floating user interface (UI).

The memory 130 may include a volatile memory and/or a non-volatilememory. The memory 130 may store, for example, commands or data relatedto one or more other components of the electronic device 101. Accordingto an embodiment, the memory 130 may store software and/or a program140. The program 140 may include, for examples, a kernel 141, middleware143, an application programming interface (API) 145, and/or an at leastone application program (or “applications”) 147. At least some of thekernel 141, the middle 143, and the API 145 may be referred to as anoperating system (OS).

The kernel 141 may control or manage system resources (for example, thebus 110, the processor 120, or the memory 130) used for executing anoperation or function implemented by other programs (for example, themiddleware 143, the API 145, or the application 147). Furthermore, thekernel 141 may provide an interface through which the middleware 143,the API 145, or the application program 147 may access individualcomponents of the electronic device 101 to control or manage systemresources.

The middleware 143 may serve as, for example, an intermediary such thatthe API 145 or the application program 147 communicate with the kernel141 to transmit/receive data. Furthermore, in regard to task requestsreceived from the application program 147, the middleware 143 mayperform a control (for example, scheduling or load balancing) for thetask requests using, for example, a method of assigning a priority forusing the system resources (for example, the bus 110, the processor 120,or the memory 130) of the electronic device 101 to at least oneapplication.

The API 145 is an interface by which the applications 147 controlfunctions provided from the kernel 141 or the middleware 143, and mayinclude, for example, at least one interface or function (for example,instructions) for file control, window control, image processing, ortext control.

For example, the input/output interface 150 may serve as an interfacethat may transfer commands or data, which is input from the user oranother external device, to the other components of the electronicdevice 101. Further, the input/output interface 150 may output commandsor data of the electronic device 101 to the user or another externaldevice.

The display 160 may include, for example, a liquid crystal display(LCD), a light emitting diode (LED) display, an organic light emittingdiode (OLED) display, a micro electro mechanical system (MEMS) display,or an electronic paper display. The display 160 may display variouscontents (for example, text, images, videos, icons, or symbols). Thedisplay 160 may include a touch screen and receive, for example, a touchinput, a gesture input, a proximity input, or a hovering input using anelectronic pen or a user's body part.

The communication interface 170 may enable communication between theelectronic device 101 and an external device (for example, a firstexternal electronic device 102, a second external electronic device 104,or a server 106). For example, the communication interface 170 may beconnected to a network 162 through wireless or wired communication tocommunicate with the external device (for example, the second externalelectronic device 104 or the server 106).

The wireless communication may include, for example, at least one oflong term evolution (LTE), LTE-advanced (LTE-A), code division multipleaccess (CDMA), wideband CDMA (WCDMA), universal mobiletelecommunications system (UMTS), wireless broadband (WiBro), and globalsystem for mobile communications (GSM) as a cellular communicationprotocol. The wired communication may include at least one of, forexample, a universal serial bus (USB), a high definition multimediainterface (HDMI), recommended standard 232 (RS-232), and a plain oldtelephone service (POTS). The network 162 may include at least one ofcommunication networks such as a computer network (for example, a localarea network (LAN) or a wide area network (WAN)), the Internet, and atelephone network.

Each of the first and second external electronic devices 102 and 104 maybe the same as or different from the electronic device 101. According toan embodiment, the server 106 may include a group of one or moreservers,

According to various embodiments, all or some of the operationsperformed by the electronic device 101 may be performed by anotherelectronic device or a plurality of electronic devices (for example, theelectronic device 102 or 104 or the server 106). According to anembodiment, when the electronic device 101 should perform some functionsor services automatically or by request, the electronic device 101 mayrequest remotely perform at least some of the functions at anotherdevice (for example, the electronic device 102 or 104 or the server106). The other electronic device (for example, the electronic device102 or 104 or the server 106) may perform the additional function andtransfer the result to the electronic device 101. The electronic device101 may provide the requested functions or services based on thereceived result or after additionally processing the received result. Tothis end, for example, cloud computing, distributed computing, orclient-server computing technology may be used.

Hereinafter, the user input received by the electronic device 101 may beone or more of the touch input, the hovering input, the voice input, andthe gesture input. The touch input or the hovering input may be made bya user's body (for example, a finger or the like) or a stylus pen. Thevoice input may be received from the user through a microphone in theelectronic device 101 and the gesture input may be received from theuser through a camera in the electronic device.

In accordance with an aspect of the present disclosure, an electronicdevice for processing a content is provided,

FIG. 2 is a flowchart of a method of processing contents by anelectronic device according to various embodiments of the presentdisclosure.

Referring to FIG. 2, the processor 120 may determine a text or imagecorresponding to a user input, for example, selecting of text or imagesthrough the display 160 in operation S202. When the text or image isselected according to the user input, the processor 120 may capture thetext or image and determine the captured text or image as a content inoperation S204. The content may be a captured image including both thetext and an image selected by the user. For example, the user selectsone area including 100 characters and 2 still images that are displayedon the screen in operation S202. The processor 120 may capture the 100characters and the 2 still images and determine the captured area as theselected content in operation S204.

Thereafter, the processor 120 may store the content in operation S206.According to an embodiment, the processor 120 may temporarily store thecontent in the memory 130. Further, the processor 120 may process thecontent according to a user input in operation S208. According to anembodiment, the processor 120 may display the content on the display, orstore, edit, share, or delete the content according to the user input inoperation S208.

According to an embodiment, the processor 120 may store or temporarilystore a plurality of contents, and process the plurality of stored ortemporarily stored contents individually or simultaneously. Beforeoperation S202, the electronic device 101 may store or temporarily storeone or more contents. The processor 120 may store or temporarily storecontents in an amount equal to a predetermined number. For example, theprocessor 120 may store or temporarily store 20 contents and processeach of the 20 contents according to a user input.

FIG. 3 is a flowchart of another method of processing contents by theelectronic device according to various embodiments of the presentdisclosure.

Referring to FIG. 3, the electronic device 101 may execute a scrap modeaccording to a user input (first input) in operation S302. When thescrap mode is executed, the processor 120 of the electronic device 101may determine whether a user input (second input) for selecting at leasta part of the image (for example, still image or dynamic image) or textdisplayed on the screen is received in operation S304.

When the second input is not received in operation S304, the processreturns back to operation S304 until a second input is received. Inanother embodiment, if the second input is not received in operationS304, the processor 120 may maintain the scrap mode without performingany operation. When the second input is received in operation S304, theprocessor 120 may capture the text or image according to the secondinput and determine the captured text or image as a first content inoperation S306.

Subsequently, the processor 120 may store the first content in operationS308. The first content may remain within the electronic device 101 eventhough power of the electronic device 101 is turned off or the scrapmode is terminated. According to an embodiment, the first content may bestored in a temporary folder and, when power is turned on, the processor120 may load the first content and display the loaded first content onthe display 160.

According to another embodiment, the first content may be storedtemporarily. When the first content is temporarily stored, the firstcontent may be automatically deleted when power of the electronic device101 is turned off or the scrap mode is terminated.

The electronic device 101 may display a floating UI including scrapinformation on the first content and a second content, which was storedbefore the first contents, on the screen in operation S310. The scrapinformation may include, for example, a thumbnail image of the firstcontent and the second content and the number of first contents and thesecond contents. For example, the processor 120 may display thumbnailimages corresponding to the first content and the second content in thefloating UI as a radial menu. According to an embodiment, the processor120 may display the floating UI on the uppermost layer (i.e., having thehighest z-order).

When the first content or the second content is stored, contentinformation, which corresponds to information on the correspondingcontent, may he stored in the memory 130. The content information mayinclude the number of images included in each of the first content andthe second content a time when each of the first content and the secondcontent is stored, and application information to which the image ortext included in each of the first content and the second content isprovided. When each of the first content and the second content isdisplayed on the display 160, the content information may be displayedtogether with the corresponding content.

Thereafter, the processor 120 may determine whether a user input i.e., athird input) for processing the first or second content is received inoperation S312. When the third input is not received in operation S312,the processor 120 may control the electronic device 101 to maintain thecurrent state without performing any operation.

When the third input is received in operation S312, the processor 120may process the first content or the second content according to thethird input in operation S314. According to an embodiment, the processor120 may display the first content or the second content on the screen,or store, edit, share, or delete the first content or the second contentaccording to the user input in operation S314. For example, theprocessor 120 may convert colors of the image included in the firstcontent or the second content into black and white, or extract the textincluded in the first content or the second content and store contactssuch as a phone number and a mail address among the text in the memory130.

Although the scrap mode is first executed and then the contentcorresponding to the user input is determined in FIG. 3, the operationmode may be automatically switched to the scrap mode when the image ortext is selected according to the user input in another embodiment. Thescrap mode may be automatically executed when a predetermined shortcutkey is input to execute the scrap mode. Further, the scrap mode may beautomatically executed when a predetermined gesture input or voice inputis input to execute the scrap mode.

In accordance with an aspect of the present disclosure, a method forprocessing a content at an electronic device is provided. The methodincludes; generating a content corresponding to a user input among oneor more contents displayed through a display of the electronic device asa first content; and displaying a floating UI, which displays firstscrap information on the first content, on a screen.

FIGS. 4A, 4B, 4C, 4D) and 4E illustrate an example of processingcontents by the electronic device according to various embodiments ofthe present disclosure.

Referring to FIG. 4A, the electronic device 101 may execute first mode401, second mode 402, third mode 403, fourth mode 404, and a scrap mode405. According to an embodiment, the processor 120 may display a modeselection table 400 for selecting the operation mode corresponding to auser input on the display 160. The user may select the operation mode ofthe electronic device 101 by selecting one of the modes 401-405. In FIG.4A, the electronic device 101 may receive a user input 411 for executingthe scrap mode 405 from the user. At this time, the user input 411 maybe, for example, tapping, clicking, or double-clicking the scrap mode405.

According to an embodiment, the processor 120 may load the modeselection table 400 according to a user input. For example, theprocessor 120 may load the mode selection table according to a touchinput for selecting a preset position of the screen continuously for apredetermined time or longer. Further, the electronic device 101 maydirectly enter the scrap mode without loading the mode selection table400 according to a user input. For example, when an area including theimage or text is selected, the scrap mode 405 is automatically executed,and then the area may be captured and stored as content. Further, thefloating UI showing scrap information on the content may be displayed.

Referring to FIGS. 4B, 4C, 4D, and 4E, an execution screen 421 accordingto a user input 410 in the scrap mode 405 is illustrated.

Referring to FIG. 4B, the user selects a part 430 of the text or imageincluded in the execution screen 421 using a finger or a stylus pen 600.The user may select the image or text within the area 430 by drawing aline from top to bottom of the area 430 including the text or image,which the user desires to select, in the execution screen 421 by usingthe stylus pen 600. Further, the processor 120 may generate a capturedimage by capturing the area 430.

According to an embodiment, the processor 120 may control the display160 to distinguish the area 430, which is selected by the user, fromother areas. In FIG. 4B, the display 160 may overlay the area 430selected by the user with a layer of a color different from thebackground color of the execution screen 421.

Referring to FIG. 4C, the captured image 430 is floated over theexecution screen 421. As illustrated in FIG. 4C, when the text or imageis selected, the processor 120 may capture the area 430 including thetext or image. Further, the processor 120 may float the captured image430 to display it over the execution screen 421.

The user may input a command for processing the captured image 430 intothe electronic device 101. According to an embodiment, the processor 120may display an icon 452 corresponding to a command for temporarilystoring the captured image 430 as content. In FIG. 4C, the user inputs auser input 412 for selecting the icon 452 into the electronic device101. At this time, the user input 412 may be, for example, clicking ordouble-clicking the icon 452. When an icon 452 is selected, theprocessor 120 may temporarily store the captured image 430 as content.According to an embodiment, when the captured image 430 includes text,the processor 1120 may display an icon 451 corresponding to a commandfor extracting and parsing the text on the captured image 430. Further,the electronic device 101 may process the captured image 430 accordingto a user input by selecting at least one of the icons 441, 442, and443.

For example, the processor 120 may store the captured image 430 in thememory 130 or delete the captured image 430 according to a user input byselecting the icon 441. The processor 120 may combine captured imagesinto one file according to the user input by selecting the icon 441. Forexample, if three contents are displayed on the display 160, theprocessor 120 may merge the three contents into a single file. Forexample, the processor 120 may merge the contents into one image ordocument file (for example, a pdf file).

Further, the captured image 430 may be shared with another applicationor other devices (for example, the electronic devices 102 and 104 or theserver 106) according to a user input by selecting the icon 442.According to an embodiment, the processor 120 may determine anapplication or a device with which the captured image 430 is sharedaccording to a user input. When the application or the device with whichthe captured image 430 is shared is determined, the processor 120 mayconvert a format of the captured image 430 into a format suitable forthe corresponding application or device. For example, when the capturedimage 430 is shared with a first application, the processor 120 mayconvert the captured image 430 into a jpg file. Further, when thecaptured image 430 is shared with a second application, the processor120 may convert the captured image 430 into a bmp file. In addition, theone captured image 430 may be simultaneously shared with a plurality ofapplications or devices. The processor 120 may convert the format of thecaptured image 430 into a format suitable for each of the applicationsand devices.

According to another embodiment, when the number of captured images 430is two or more, the processor 120 may combine the captured images 430into one file and share the file. For example, the processor 120 maycombine three captured images 430 into one captured image and share thecombined captured image. Further, the processor 120 may share each ofthe captured images 430 with each of the applications or devices. Forexample, when the number of captured images 430 is three, the processor120 may sequentially transmit the three captured images 430 to theapplications or the devices.

According to another embodiment, when the captured image 430 correspondsto an image generated by capturing only text, the processor 120 mayextract characters from the captured image and share only the extractedcharacters with the applications or the devices. When the captured image430 includes both the image and the text, the processor 120 may sharethe captured image 430 by transmitting each of the image and the textextracted from the captured image 430 to the applications or thedevices. According to an embodiment, the applications or the devices,with which the captured image 430 is shared, may display both the imageand the text or display only one of the image and the text according tothe specification of the corresponding applications or devices.

Further, the processor 120 may edit information on the captured image430 (for example, a tag including a photographing time of the imageincluded in the captured image 430, a file size, a resolution, a filepath, and like) according to a user input by selecting the icon 443.

Referring to FIG. 4D, when the captured image 430 is temporarily storedas a content, the electronic device 101 may display a floating UI 450 onthe screen. The floating UI 450 may be a UT which informs the user thatthe captured image captured in FIG. 4D is temporarily stored in theelectronic device 101. According to an embodiment, thumbnail imagescorresponding to one or more temporarily stored contents and the numberof temporarily stored contents may be displayed through the floating UI450. The floating UI 450 may have a form in which the thumbnail imagesoverlap each other in a radial shape, a form in which the thumbnailimages are horizontally arranged and overlap each other, or a form inwhich the thumbnail images are vertically arranged and overlap eachother, and may have an animation in which the thumbnail images arerotated every preset time (for example, every one second). According toan embodiment, the processor 120 may display the floating UI 450 on theuppermost layer (i.e., with the highest z-order). Accordingly, thefloating UI 450 may be displayed in the entire area of the screen of thedisplay 160.

Referring to FIG. 4E, the processor 120 may display a thumbnail image ofthe content 430 through the floating UI 450 to inform that the content430 is temporarily stored. Further, the content 430 is temporarilystored, the processor 120 may display “1” via the floating UI toindicate the number of temporarily stored contents.

Referring to FIG. 4D, the electronic device 101 receives a user input413 for selecting the floating UI 450. When the electronic device 101receives the user input 413, the processor 120 may control the display160 to display the temporarily stored content 430 in the form of, forexample, a popup window.

Referring to FIG. 4E, the temporarily stored content 430 in the form ofthe popup window is floated. Since the content 430 includes text, theprocessor 120 may display, on the content 430, an icon 451 correspondingto a command for extracting and parsing the text included in thecontents 430. Further, when the content is loaded through the floatingUI 450, the processor 120 may control the display 160 to not display thefloating UI 450 or to display the floating UI 450 on a lower layer ofthe layer including the content 430, so as to make the floating UI 450hidden by the content 430.

FIGS. 5A, 5B, 5C, and 5D illustrate another example of processing thecontents by the electronic device according to various embodiments ofthe present disclosure.

Referring to FIG. 5A, an image selected according to a user input iscaptured and floated on an execution screen 521. When an image on theexecution screen 521 is selected according to a user input, the imagemay be captured, and the icon 452 corresponding to the command fortemporarily storing the captured image 531 as a content may be displayedon the image. According to an embodiment, since the captured image 531does not include text in FIG. 5A, the icon 451 corresponding to thecommand for parsing the text may not be displayed on the captured image531.

FIG. 5B illustrates an execution 521 after the capture image, that is,the content 531 is temporarily stored, and a scrap window 570 showingtemporarily stored content 531 and 532 together. Referring to FIG. 5B,the floating UI 450 may be displayed on the execution screen 521.Although FIG. 5B illustrates the floating UI 450 on an upper right partof the execution screen 521, the floating UI 450 may be located at anypart of the execution screen 521. The floating UI 540 may display thenumber of temporarily stored contents and a thumbnail imagecorresponding to each of the temporarily stored contents. In FIG. 5B, athumbnail image reduced from the captured image, that is, the content531 is displayed through the floating UI 450.

Referring to FIG. 5C, the processor 120 displays another executionscreen 522 on the display 160 after the content 531 is temporarilystored. In FIG. 5C, it is assumed that the number of temporarily storedcontents is plural. The processor 120 may display a floating window 560including temporarily stored contents or thumbnail images 561, 562 and563 corresponding to the contents on the execution screen 522. Thefloating window 560 may include the thumbnail images corresponding tothe temporarily stored contents. For example, when there are 30 storedcontents, the floating window 560 may also display all 30 thumbnailimages. Although only the three thumbnail images 561, 562, and 563 aredisplayed in the floating window 560 in FIG. 5C, the processor 120 maydisplay more thumbnail images through the floating window 560 accordingto a user input for scrolling the floating window 560.

Referring to FIG. 5D, the temporarily stored contents 531, 532, and 533are displayed together. As illustrated in FIG. 5D, the scrap screen maydisplay the temporarily stored contents 531, 532, and 533 sequentiallyin an order of temporary storage (i.e., either ascending or descendingin time).

The scrap screen may include icons 571, 572, and 573 corresponding tocommands for processing the temporarily stored contents 531-533. Theprocessor 120 may process the contents 531-533 according to a user inputfor selecting one of the icons 571-573. For example, when the icon 571is selected by the user, the processor 120 may switch the screen to anexecution screen 531. When the icon 572 is selected by the user, theprocessor 120 may share the corresponding content with anotherapplication or other devices (for example, the electronic devices 102and 104 or the server 106). When the icon 573 is selected by the user,the processor 120 may delete the corresponding content.

According to an embodiment, the processor 120 may select one of thecontents 531, 532, and 533 and then process the corresponding contentaccording to a user input for selecting one of the icons 571-573.According to another embodiment, the user may select one of the contents531-533 and request processing the corresponding content to theelectronic device 101 by dragging the selected content to one of theicons 571-573. According to another embodiment, the user may select oneof the contents 531-533 and then make a request for deleting the contentto the electronic device 101 by dragging the corresponding content tothe left or right side.

FIGS. 6A, 6B, 6C, and 6D illustrate an example of selecting a contentaccording to a user input by the electronic device 101 according tovarious embodiments of the present disclosure.

FIG. 6A illustrates an operation mode of the electronic device 101, anda scrap mode is selected according to a user input. Referring to FIG.6A, the electronic device 101 may execute the first to fourth modes 401,402, 403, and 404, and the scrap mode 405. According to an embodiment,the processor 120 may display the mode selection table 400 for selectingthe operation mode corresponding to a user input on the display 160. Theuser may select the operation mode of the electronic device 101 byselecting one of the modes 401-405. The electronic device 101 mayreceive a user input 601 for executing the scrap mode 405 from the user.At this time, the user input 601 may be, for example, clicking ordouble-clicking the scrap mode 405. The user input 601 may be made byselecting the scrap mode 405 using a stylus pen 600 by the user.

Referring to FIG. 6B, an area 641 is illustrated in which a content tobe temporarily stored is selected according to a user input. The usermay select the area 641 including an image or text through the styluspen 600 and capture the image or text included in the area 641. Further,the user may input a command for temporarily storing the captured imageas a content into the electronic device 101.

Referring to FIG. 6B, the user selects the area 641 including the imageor text by inputting, into the electronic device 101, a user input 602for selecting a virtual OK button 602 displayed on the execution screen621 through the display 160.

Referring to FIG. 6C, a user input 603 for selecting contents to betemporarily stored is illustrated.

Referring to FIG. 6C, the user draws a diagonal line 603 from the upperleft part of the execution screen 621 by using the stylus pen 600. Theprocessor 120 may determine a rectangle including the diagonal line asthe area including the image or text which the user desires totemporarily store. Referring to FIG. 6D, a captured image 631 generatedby the user input 603 in FIG. 6C is illustrated. In order to indicatethat the image or text is selected according to the user input 603, theprocessor 120 may control the display 160 such that a layer with a colordifferent from the background color of the execution screen 621 islocated on the area 631 including the image or text.

FIGS. 7A, 7B, 7C, and 7D illustrate another example of processing thecontents by the electronic device according to various embodiments ofthe present disclosure.

Referring to FIGS. 7A, the electronic device 101 selects or temporarilystores text or an image among the images or text included in anexecution screen 721 as content 730 according to a user input.

FIG. 7A illustrates icons 441, 442, 443, 451, and 452 corresponding tocommands for processing the stored content 730. When an image or text isselected in the execution screen 721, the processor 120 may capture theselected image or content, and separately float the captured image 731on an execution screen 721. The user may temporarily store the capturedimage 731 as a content by inputting a user input for selecting the icon452.

Referring to FIG. 7B, content 732 only stores an image. Referring toFIG. 7C, content 732 stores an image and text. Referring to FIG. 7D),content 733 only includes text. As illustrated in FIGS. 7A to 7C, theelectronic device 101 may temporarily store the contents 731, 732, and733 according to a user input by selecting the icon 452. Further, inFIGS. 7B and 7C, the electronic device 101 may extract and parse textincluded in the contents 732 and 733 by selecting the icon 451.

FIGS. 8A and 8B illustrate another example of processing the contents bythe electronic device according to various embodiments of the presentdisclosure,

Referring to FIG. 8A, a captured image 831 that is generated bycapturing an area in an execution screen 821 is floated.

Since the content 831 illustrated in FIG. 8A is a still image, the textincluded in the content 831 is also included as a part of the stillimage. The processor 120 may extract text data from the content 831through, for example, an OCR scheme. Referring to FIG. 8B, text data 832is illustrated and was extracted from the content 831. In FIGS. 8A and8B, the processor 120 may temporarily store the capture image 831 as acontent.

According to an embodiment, the processor 120 may parse the text data832. The processor 120 may parse all of characters, numbers, and specialletters included in the text data 832. The processor 120 may share thetext data 832 with all applications, that can be executed by theelectronic device 101, or with other devices (for example, theelectronic devices 102 and 104 or the server 106) according to the userinput for selecting the icon 442. Further, the processor 120 may extractcontacts such as an address, a phone number, a mail address, and awebsite address included in the text data 832 and may determine theextracted data as scrap information on the content 831. The processor120 may temporarily store the scrap information to correspond to thecontent 831 and display the scrap information through the floating UI450.

According to an embodiment, the processor 120 may display, on theexecution screen 831, a predetermined image (for example, a loadingimage) indicating that the text data 832 is being extracted until thetext data 832 can be displayed on the display 160 as illustrated in FIG.8B.

FIG. 9 illustrates another example of processing the content by theelectronic device 101 according to various embodiments of the presentdisclosure.

Referring to FIG. 9, an example is illustrated in which the processor120 may extract information the text data 832 as results 931-935.According to an embodiment, the processor 1120 may separately extractonly an image from the content 831, Further, the processor 120 maycontrol the display 160 to display a result of analysis of the text data832 close to the text data 832. In FIG. 9, results 931 to 935 of theanalysis of the text data 832 are displayed on the lower part of thetext data 832.

The processor 120 may extract a phone number 931 from the text data 832.Further, the processor 120 may also display icons 941 corresponding to acommand for processing the phone number 931. The processor 120 may sharethe phone number 931 with another application or an electronic device(for example, the electronic device 102 or 104, or the server 106)according to a user input applied to one of the icons 941. For example,the processor 120 may call, send a mail, send a text message to thephone number 931, or add the phone number 931 to an address book byselecting one of the icons 941. According to an embodiment, when thereare multiple phone numbers included in the text data 932, the processor120 may sequentially display phone numbers 961 and 962 and display amail address 963 together with the phone numbers 961 and 962.

The processor 120 may extract an email address 932 from the text data832. Further, the processor 120 may also display icons 942 correspondingto a. command for processing the email address 932. The processor 120may share the mail address 932 with another application or an electronicdevice (for example, the electronic device 102 or 104, or the server106) by selecting one of the icons 942. Further, the processor 120 mayshare the email address 932, transmit an email to the email address 932,transmit a message to the email address 932, or add the email address932 to the address book by selecting one of the icons 942.

The processor 120 may extract schedule information 933 from the textdata 832. When the schedule is extracted, the processor 120 may managethe user's schedule by adding the schedule 933 information to a calendarapp. Further, the processor 120 may also display icons 943 correspondingto a command for processing the schedule information 933. The processor120 may share the schedule information 933 with another application oran electronic device (for example, the electronic device 102 or 104, orthe server 106) by selecting one of the icons 943. Further, theprocessor 120 may share the schedule information 933 or add the scheduleinformation 933 to the calendar app preinstalled in the electronicdevice 101 by selecting one of the icons 943.

The processor 120 may extract a website address from the text data 832and display the website 934 below the text data 832. Further, theprocessor 120 may also display icons 944 corresponding to a command forprocessing the website address. The processor 120 may share the website934 with another application or an electronic device (for example, theelectronic device 102 or 104, or the server 106) by selecting one of theicons 944. Further, the processor 120 may browse the website 934 througha browser or add the website 934 to a bookmark list by selecting one ofthe icons 944.

The processor 120 may extract map data 935 (for example, an address or aGPS coordinate) from the text data 832. The processor 120 may displaythe map 935 including a position corresponding to the map data below thetext data 832. Further, the processor 120 may also display icons 945corresponding to a command for processing the map data 935 together withthe map data 935. The processor 120 may share the map data 935 withanother application or an electronic device (for example, the electronicdevice 102 or 104, or the server 106) by selecting one of the icons 945.Further, the processor 120 may display an address included in the textdata on the map 935 by selecting one of the icons 945.

FIGS. 10A, 10B, 10C, 10D, 10E, 10F, 10G, and 10H illustrate anotherexample of processing the contents by the electronic device according tovarious embodiments of the present disclosure.

Referring to FIG. 10A, the processor 120 may capture an area includingan image and text from an execution screen 1021 and temporarily storethe captured image 1031 as first a content. FIG. 10A floats and displaysthe temporarily stored first content 1031. When the first content 1031is temporarily stored, a thumbnail image corresponding to the firstcontent 1031 may be displayed in the floating UI 450.

Referring to FIG. 10B, when it is assumed that the temporarily storedcontent corresponds to the first content 1031, a floating UI 450 maydisplay “1” as the number of temporarily stored contents.

Subsequently, the processor 120 may capture an area including one imagefrom an execution screen 1022 and temporarily store the captured image1032 as a second content. Referring to FIG. 10C, a user input forselecting the area including the image from the execution screen 1022 isillustrated. The user may select the area 1032 through the stylus pen600 and capture the image or text included in the area 1032.

Referring to FIG. 10D, the captured image 1032 is floated on theexecution screen 1022. The processor 120 may temporarily store thecaptured image 1032. Further, the processor 120 may convert the capturedimage 1032 into the second content and temporarily store the secondcontent.

Referring to FIG. 10E, the processor 120 may display, on the executionscreen 1022, the floating UI 450 to which a thumbnail imagecorresponding to the second content 1032 is added. Since the number oftemporarily stored contents is 2, the floating UI 450 may display “2” asthe number of temporarily stored contents.

Subsequently, the processor 120 may capture an area including threeimages from the execution screen 1022 and temporarily store the capturedimages 1033 as a third content. Referring to FIG. 10F, a user input forselecting the area is illustrated and includes the three images from theexecution screen 1022. The user may select the area 1033 through thestylus pen 600 to determine the area including the image or text to betemporarily stored. Referring to FIG. 10G, the temporarily stored thirdcontent 1033 is floated on the execution screen 1022. The processor 120may convert the captured image 1033 into the second content 1033 andtemporarily store the second contents.

The processor 120 may display, on the execution screen 1022, thefloating UI 450 to which a thumbnail image corresponding to the thirdcontent 1033 is added. Since the number of temporarily stored contentsis 3, the floating UI 450 may display “3” as the number of temporarilystored contents. Referring to FIG. 10H, thumbnail images displayedthrough the floating UI 450 may be displayed to partially overlap eachother. At this time, with respect to the thumbnail images correspondingto the temporarily stored contents, the floating UI 450 may firstdisplay the thumbnail image corresponding to the contents stored later.In contrast, with respect to the thumbnail images corresponding to thetemporarily stored contents, the floating UI 450 may first display thethumbnail image corresponding to the contents stored relatively earlier.

FIGS. 11A, 11B, 11C, and 11D illustrate another example of processingthe contents by the electronic device 101 according to variousembodiments of the present disclosure.

Referring to FIG. 11A, a popup window 1151 including thumbnail images1131, 1132, and 1133 corresponding to temporarily stored contents isdisplayed on an execution screen 1121. The popup window 1151 is anexample of the floating UI 450, and may be displayed on executionscreens 1121, 1122, and 1123 including thumbnail images 1131, 1132, and1133 of temporarily stored contents. The popup window 1151 may bedisplayed at any position of the execution screen 1121 and may be moveaccording to a user input. In FIG. 11A, the popup window 1151 isdisplayed on an upper right part of the execution screen 1121. Referringto FIG. 11B, a popup window 1152 including thumbnail images 1134, 1135,and 1136 corresponding to the temporarily stored contents is displayedon a lower left part of the execution screen 1122.

Referring to FIG. 11A, a user input 1101 is input for selecting onethumbnail image 1133 by dragging the selected thumbnail image 1133 in adiagonal direction . The processor 120 may move the contentscorresponding to the thumbnail image 1131-1133 according to the userinput 1101. Referring to FIG. 11B, the popup window 1151 moves based onthe user input 1101 and is positioned on a lower left part of theexecution screen 1122. Referring to FIG. 11B, the popup window 1152moved according to the user input 1101 is displayed on a lower left partof the execution screen 1122. FIGS. 11C and 11D illustrate an examplefor moving temporarily stored contents 1134 to 1136 to the executionscreen 1123 by using a popup window 1151.

Referring to FIG. 11C, the processor 120 displays a text message windowaccording to a message transmission/reception application as theexecution screen 1123. The electronic device 101 receives a user input1102 for selecting the thumbnail image 1134 and dragging the selectedthumbnail image 1134 in a diagonal direction. According to anembodiment, the electronic device 101 may move the thumbnail image 1134to an input window 1171 of the execution screen 1123.

The processor 120 may move the contents 1134 corresponding to thethumbnail image 1134 to the execution screen 1123 according to the userinput 1102 as illustrated in FIG. 11C. That is, the processor 120 mayallow the user to use the contents 1134 in an application by moving thecontents 1134 according to the user input 1102. Referring to FIG. 11D,the user may transmit the contents 1134 to another device through themessage transmission/reception application.

FIGS. 12A and 12B illustrate another example of processing the contentsby the electronic device according to various embodiments of the presentdisclosure. In FIGS. 12A and 12B, screens displaying a list 1210 oftemporarily stored contents are illustrated.

Referring to FIG. 12A, the processor 120 may generate a list 1210 inwhich temporarily stored contents 1211, 1212, and 1213 are arrangedbased on when the contents 1211-1213 are stored. The processor 120 mayexecute a command corresponding to each of the icons 441, 442, and 443.For example, the processor 120 may store, delete, share and edit atleast one of the contents 1211-1213 according to the user input.Referring to FIG. 12A, a user input 1201 for deleting the first contents1211 is input. The processor 120 may remove the selected first content1211 from the list 1210. Referring to FIG. 12B, the list 1210 having thefirst content 1211 is removed is illustrated.

According to another embodiment, the processor 120 may delete thecorresponding content from the list 1210 by receiving a user input forselecting the icon 1223 displayed on each of the contents 1211-1213.

FIGS. 13A, 13B, and 13C illustrate another example of processing thecontents by the electronic device according to various embodiments ofthe present disclosure.

Referring to FIG. 13A, the processor 120 may receive a user input forselecting text displayed on an execution screen 1311 through the styluspen 600. The processor 120 may control the display 160 such that theselected text 1331 is underlined. An area including the selected text orimage may be captured and temporarily stored as a content. Asillustrated in FIG. 13A, the user may select a desired image or text byinputting a user input for underlining the desired image or text intothe electronic device 101.

Referring to FIG. 13B, when the text or image is selected, the processor120 may display an editing menu 1350. The user may determine a method ofprocessing the selected image or text by selecting one of the menusincluded in the editing menu 1350. In FIG. 13B, the user selects the“see together” menu. Referring to FIG. 13C, in response to the selectedmenu item, an operation according to the selected menu in FIG. 13B isexecuted. The execution screen displays only the image or the textselected by the user in FIG. 13A.

FIGS. 14A and 14B illustrate another example of processing the contentsby the electronic device according to various embodiments of the presentdisclosure.

Referring to FIG. 14A, a user input 1401 for the “see together” functionis provided. The processor 120 may control the display 160 to displayonly the image or the text selected by the user according to the userinput 1401.

Referring to FIG. 14B, when the image or the text is selected accordingto the user input, the processor 120 may control the display 160 todistinguish between texts included in different paragraphs. In FIG. 14B,a text included in a first paragraph and a text included in a secondparagraph are selected according to a user input.

FIGS. 15A, 15B, 15C, and 15D illustrate another example of processingthe contents by the electronic device according to various embodimentsof the present disclosure.

Referring to FIG. 15A, an execution screen 1521 illustrates execution ofa first application.

Referring to FIG. 15A, the processor 120 may capture an area 1531including an image or a text corresponding to a user input andtemporarily store the captured image as content 1532.

The processor 120 may move the content 1532 to an execution screen thatexecutes an application different from the first application accordingto a user input.

Referring to FIG. 15B, the content 1532 is moved to an execution screen1522 that executes a second application. Since the content 1532 includesboth the image and the text, the second application may receive both theimage and the text included in the content 1532. According to anotherembodiment, scrap information on the content 1532 may be input into thesecond application. The user may more the content 1532 to the secondapplication by dragging the selected image or text to the executionscreen 1522.

Referring to FIG. 15C, the content 1532 is displayed on the executionscreen 1522 that executes the second application. According to anembodiment, the processor 120 may copy the content 1532 to the secondapplication.

Referring to FIG. 15D, the content 1532 is moved or copied to anapplication other than the first application. In FIG. 15D, a thirdapplication is a messenger. The user may display the content 1532 in amessenger window 1523 by dragging the content 1532 to the messengerwindow 1523.

FIG. 16 illustrates another example of processing the contents by theelectronic device according to various embodiments of the presentdisclosure.

Referring to FIG. 16, the processor 120 may extract a website address1620 displayed in the browser window 1610 according to a user input. Forexample, the user input may be a flick on the browser window 1610 byusing a finger or the stylus pen 600, and another type of input (forexample, a hovering input, a voice input, a gesture input, or the like)may be recognized by the electronic device 101 as the user input forextracting the website address 1620.

When the website address 1620 is extracted, the processor 120 maytemporarily store the website address 1620 and display the websiteaddress 1620 on the right side of the browser window 1610 as illustratedin FIG. 16. According to another embodiment, the user may delete thewebsite address 1620 by a drag input by a directional input on thewebsite address 1620 from top to bottom or from bottom to top.

FIG. 17 illustrates another example of processing the contents by theelectronic device according to various embodiments of the presentdisclosure.

Referring to FIG. 17, when the electronic device 101 is implemented tohave dual monitors, the processor 120 temporarily stores the extractedwebsite address 1620 and copies and inputs the website address 1620 intoan execution screen 1720 of a different application. For example, theprocessor 120 may copy the website address 1620 extracted from thebrowser window 1620 and input the website address 1620 into an inputwindow 1721 of the execution screen 1720.

FIGS. 18A and 18B illustrate another example of processing the contentsby the electronic device according to various embodiments of the presentdisclosure.

Referring to FIGS. 18A and 18B, an example of a hypertext markuplanguage (HTML) document is displayed by a browser application. Whentext or images included in the Internet page is selected by theprocessor 120, the selected text or images are stored as a content. Theprocessor 120 may determine the position (for example, a line) of thehtml document at which the part selected by the user is located. Theprocessor 120 may insert “f727to732f890t932” into a uniform resourcelocator (URL) corresponding to lines 727-732 and 890-932 of the htmldocument and store the URL or transmit the URL to another externaldevice (for example, the electronic device 102 or 104, or the server106). For example, the processor 120 may transmit“http://ss.com/253#f728t760f820t884” to another external electronicdevice. The processor 120 may show images or text corresponding to lines727-732 and lines 890-932. For example, the processor 120 may controlthe display 160 to show the corresponding area by scrolling the Internetpage to allow the user to intuitively identify the area including theimages or texts corresponding to the lines 727-732 and the lines 890-932by using the URL. Further, the processor 120 may show the area includingthe images or text corresponding to the lines 727-732 and the lines890-932 to be in contrast with other areas of the Internet page.

FIGS. 19A, 19B, and 19C illustrate another example of processing thecontents by the electronic device according to various embodiments ofthe present disclosure

Referring to FIG. 19A, an execution screen 1921 includes a character ortext and the user selects text by using the stylus pen 600. Further, theprocessor 120 may display a menu bar 1925 for processing the selectedtext 1932. In FIG. 19A, the user selects a “memo” function from the menubar 1925.

Referring to FIG. 19B, since the memo function is selected, theprocessor 120 may control the display 160 to float and display a memowindow 1940 on the execution screen 1921. The processor 120 maydistinguish the text 1932 selected by the user from texts, which are notselected, through the display 160. Further, the electronic device 101may receive a memo through the user's finger or the stylus pen 600. Atthis time, the memo may be related to the selected text 1932.

Referring to FIG. 19C, after the memo is completely input, the processor120 may hide the memo window 1941. Further, the processor 120 may informthe user that the memo related to the text 1932 exists by displaying amemo icon 1942.

FIG. 20 is a block diagram of an electronic device according to variousembodiments of the present disclosure.

Referring to FIG. 20, an electronic device 2001 may include, forexample, all or some of the electronic device 101 illustrated in FIG. 1.The electronic device 2001 may include at least one AP 2010, acommunication module 2020, a subscriber identification module (SIM) card2024, a memory 2030, a sensor module 2040, an input device 2050, adisplay 2060, an interface 2070, an audio module 2080, a camera module2091, a power management module 2095, a battery 2096, an indicator 2097,and a motor 2098.

The AP 2010 may control a plurality of hardware or software componentsconnected thereto by driving an operating system or an applicationprogram and perform a variety of data processing and calculations. TheAP 2010 may be embodied as, for example, a system on chip (SoC).According to an embodiment, the AP 2010 may further include a graphicprocessing unit (GPU) and/or an image signal processor. The AP 2010 mayinclude some of the components (for example, the cellular module 2021)illustrated in FIG. 20. The AP 2010 may load instructions or data,received from at least one other element (for example, a non-volatilememory), in a volatile memory to process the loaded instructions or dataand may store various types of data in a non-volatile memory.

The communication module 2020 may be similar to the communicationinterface 200 of FIG. 1. The communication module 2020 may include, forexample, a cellular module 2021, a Wi-Fi module 2023, a Bluetooth (BT)module 2025, a GPS module 2027, a near field communication (NFC) module2028, and a radio frequency (RF) module 2029.

The cellular module 2021 may provide a voice call, image call, shortmessaging service (SMS), or Internet service through, for example, acommunication network. According to an embodiment, the cellular module2021 may distinguish between and authenticate electronic devices 2001within a communication network using a subscriber identification module(for example, the SIM card 2024). According to an embodiment of thepresent disclosure, the cellular module 2021 may perform at least someof functions that the AP 2010 may provide. According to an embodiment ofthe present disclosure, the cellular module 2021 may include a CP.

The Wi-Fi module 2023, the BT module 2025, the GPS module 2027, and theNYC module 2028 may include, for example, a processor for processingdata transmitted/received through the corresponding module. According toany embodiment, at least some (two or more) of the cellular module 2021,the Wi-Fi module 2023, the BT module 2025, the GPS module 2027, and theNFC module 2028 may be included in one integrated chip (IC) or ICpackage.

The RF module 2029 may transmit/receive, for example, a communicationsignal (e.g., an RF signal). The RF module 2029 may include, forexample, a transceiver, a power amp module (PAM), a frequency filter, alow noise amplifier (LNA), or an antenna. According to anotherembodiment, at least one of the cellular module 2021, the Wi-Fi module2023, the 131 module 2025, the GPS module 2027, and the NFC module 2028may transmit/receive an RF signal through a separate RF module 2029.

The SIM card 2024 may include, for example, a card including asubscriber identification module and/or an embedded SIM, and may furtherinclude unique identification information (for example, an IntegratedCircuit Card Identifier (ICCID)) or subscriber information (for example,International Mobile Subscriber Identity (IMSI)).

The memory 2030 (for example, the memory 130) may include, for example,an internal memory 2032 or an external memory 2034. The internal memory2032 may include at least one of a volatile memory (for example, adynamic random access memory (DRAM), a static RAM (SRAM), a synchronousdynamic RAM (SDRAM), and the like) and a non-volatile memory (forexample, a one time programmable read only memory (OTPROM), aprogrammable ROM (PROM), an erasable and programmable ROM (EPROM), anelectrically erasable and programmable ROM (EEPROM), a mask ROM, a flashROM, a flash memory (for example, a NAND flash memory or a NOR flashmemory), a hard disc drive, a solid state drive (SSD), and the like).

The external memory 2034 may further include a flash drive, for example,a compact flash (CF), a secure digital (SD), a micro secure digital(Micro-SD), a mini secure digital (Mini-SD), an extreme Digital (xD), amemory stick or the like. The external memory 2034 may be functionallyand/or physically connected to the electronic device 2001 throughvarious interfaces.

The sensor module 2040 may measure a physical quantity or detect anoperation state of the electronic device 2001, and may convert themeasured or detected information to an electrical signal. The sensormodule 2040 may include at least one of, for example, a gesture sensor2040A, a gyro sensor 2404B, an atmospheric pressure sensor 2040C, amagnetic sensor 2040D, an acceleration sensor 2040E, a grip sensor2040F, a proximity sensor 2040G, a color sensor 2040H (for example, ared/green/blue (RUB) sensor), a biometric sensor 20401, atemperature/humidity sensor 2040J, an illumination sensor 2040K, and anultra violet (UV) sensor 2040M. Additionally or alternatively, thesensor module 2040 may include an E-nose sensor, an electromyography(EMG) sensor, an electroencephalogram (EEG) sensor, an electrocardiogram(ECU) sensor, an infrared (IR) sensor, an iris sensor, and/or afingerprint sensor. The sensor module 2040 may further include a controlcircuit for controlling at least one sensor included therein. In someembodiments, the electronic device 2001 may further include a processorconfigured to control the sensor module 2040 as a part of or separatelyfrom the AP 2010, and may control the sensor module 2040 while the AP2010 is in a sleep state.

The input device 2050 may include, for example, a touch panel 2052, a(digital) pen sensor 2054, a key 2056, or an ultrasonic input device2058. The touch panel 2052 may use at least one of, for example, acapacitive type, a resistive type, an infrared type, and an ultrasonictype. The touch panel 2052 may further include a control circuit. Thetouch panel 2052 may further include a tactile layer and provide atactile reaction to the user.

The (digital) pen sensor 2054 may be, for example, a part of the touchpanel 2052 or may include a separate recognition sheet. The key 2056 mayinclude, for example, a physical button, an optical key or a keypad. Theultrasonic input unit 2058 may identify data by detecting an acousticwave with a microphone (for example, microphone 2088) of the electronicdevice 2001 through an input unit for generating an ultrasonic signal.

The display 2060 (for example, the display 160) may include a panel2062, a hologram device 2064, or a projector 2066. The panel 2062 mayinclude a component equal or similar to the display 160 of FIG. 1. A Thepanel 2062 may be embodied to be, for example, flexible, transparent, orwearable. The panel 2062 may also be integrated with the touch panel2052 as a single module. The hologram device 2064 may show astereoscopic image in the air using interference of light. The projector2066 may project light onto a screen to display an image. For example,the screen may be located inside or outside the electronic device 2001.According to an embodiment of the present disclosure, the display 2060may further include a control circuit (not shown) for controlling thepanel 2062, the hologram device 2064, or the projector 2066.

The interface 2070 may include, for example, an HDMI 2072, a USB 2074,an optical interface 2076, or a D-subminiature (D-sub) 2078. Theinterface 2070 may be included in, for example, the communicationinterface 170 illustrated in FIG. 1. Additionally or alternatively, theinterface 2070 may include, for example, a mobile high-definition link(Min) interface, an SD card/multi-media card (MMC) interface, or aninfrared data association (IrDA) standard interface.

The audio module 2080 may bilaterally convert, for example, a sound andan electrical signal. At least some components of the audio module 2080may be included, in, for example, the input/output interface 150illustrated in FIG. 1. The audio module 2080 may process voiceinformation input or output through, for example, a speaker 2082, areceiver 2084, earphones 2086, or the microphone 2088.

The camera module 2091 may photograph a still image and a dynamic image.According to an embodiment, the camera module 291 may include one ormore image sensors (for example, a front sensor or a back sensor), alens, an image signal processor (ISP) or a flash (for example, LED orxenon lamp).

The power management module 2095 may manage, for example, power of theelectronic device 2001. According to an embodiment, the power managementmodule 2095 may include a power management integrated circuit (PMIC), acharger IC, or a battery or fuel gauge. The PMIC may have a wired and/orwireless charging scheme. A magnetic resonance scheme, a magneticinduction scheme, or an electromagnetic scheme may be exemplified as thewireless charging method, and an additional circuit for wirelesscharging, such as a coil loop circuit, a resonance circuit, a rectifiercircuit, and the like may be added. The battery gauge may measure, forexample, a residual quantity of the battery 2096, a voltage, a current,or a temperature during charging. The battery 2096 may include, forexample, a rechargeable battery or a solar battery.

The indicator 2097 may indicate particular status of the electronicdevice 2001 or a part thereof (for example, the AP 2010), for example, abooting status, a message status, a charging status, or the like. Themotor 2098 may convert an electrical signal into mechanical vibrations,and may generate a vibration or haptic effect. Although not illustrated,the electronic device 2001 may include a processing device (for example,a GPU) for supporting mobile TV. The processing unit for supporting themobile television (TV) may process media data according to a standard ofdigital multimedia broadcasting (DMB), digital video broadcasting (DVB),media flow or the like.

Each of the above-described elements of the electronic device 2001 maybe implemented by one or more components and the name of thecorresponding element may vary depending on the type of the electronicdevice 2001. In various embodiments of the present disclosure, theelectronic device 2001 may include at least one of the above-describedelements, and may exclude some of the elements or further include otheradditional elements. Further, some of the elements of the electronicdevice 2001 according to various embodiments may be combined into oneentity, so that the functions of the corresponding elements may beperformed in the same way as those before they are combined.

FIG. 21 is a block diagram of a program module according to variousembodiments of the present disclosure.

Referring to FIG. 21, a program module 2110 (for example, the program140) may include an OS for controlling resources related to theelectronic device (for example, the electronic device 101) and/orvarious applications (for example, the application programs 147)executed in the OS. The OS may be, for example, Android®, iOS®,Windows®, Symbian®, Tizen®, Bada®, or the like.

The program module 2110 may include a kernel 2120, middleware 2130, anAPI 2160, and/or at least one application 2170. At least some of theprogram module 2110 may be preloaded in the electronic device ordownloaded from a server (for example, the server 106).

The kernel 2120 (for example, the kernel 141 of FIG. 1) may include, forexample, a system resource manager 2121 or a device driver 2123. Thesystem resource manager 2121 may perform the control, allotment orcollection of the system resources. According to an embodiment, thesystem resource manager 2121 may include a process manager, a memorymanager, or a file system manager. The device driver 2123 may include,for example, a display driver, a camera driver, a BT driver, ashared-memory driver, a USB driver, a keypad driver, a Wi-Fi driver, anaudio driver, or an inter-process communication (IPC) driver.

The middleware 2130 may provide a function required by the application2170 through the API 2160 so that the application 2170 can efficientlyuse limited system resources of the electronic device. According to anembodiment, the middleware 2130 (for example, the middleware 143) mayinclude, for example, at least one of a runtime library 2135, anapplication manager 2141, a window manager 2142, a multimedia. manager2143, a resource manager 2144, a power manager 2145, a database manager2146, a package manager 2147, a connectivity manager 2148, anotification manager 2149, a location manager 2150, a graphic manager2151, and a security manager 2152.

The runtime library 2135 may include, for example, a library module thata compiler uses to add new functions through a programming languagewhile executing the application 2170. The runtime library 2135 mayperform input/output management, memory management, or an arithmeticfunction.

The application manager 2141 may manage, for example, a life cycle ofthe application 2170. The window manager 2142 may manage a graphicaluser interface (GUI) resource used in the screen. The multimedia manager2143 may detect a format required for reproducing various media filesand encode or decode a media file using a codec appropriate for thecorresponding format. The resource manager 2144 may manage resourcessuch as a source code, a memory or a storage space of the application2170.

The power manager 2145 may operate together with a basic input/outputsystem (BIOS) to manage a battery or power and may provide powerinformation required for the operation of the electronic device. Thedatabase manager 2146 may generate, search for, or change a database tobe used by at least one of the applications 2170. The package manager2147 may manage the installation or the updating of applicationsdistributed in the form of package file.

For example, the connectivity manager 2148 may manage wirelessconnections, such as Wi-Fi or BT. The notification manager 2149 maydisplay or notify an event such as a received message, an appointment,and a proximity notification to a user without disturbance. The locationmanager 2150 may manage location information of the electronic device.The graphic manager 2151 may manage graphic effects to be provided to auser and user interfaces. The security manager 2152 may provide varioussecurity functions required for system security or user authentication.According to an embodiment, when the electronic device (for example,electronic device 101) has a call function, the middleware 2130 mayfurther include a telephony manager for managing a voice call functionor a video call function of the electronic device.

The middleware 2130 may include a middleware module that forms acombination of various functions of the aforementioned components. Themiddleware 2130 may provide modules specialized according to types ofoperating systems in order to provide differentiated functions. Inaddition, the middleware 2130 may dynamically remove the conventionalcomponents, or add new components.

The API 2160 (for example, the API 145), which is a set of APIprogramming functions, may include different configurations according tooperating systems. For example, with respect to each platform, one APIset may be provided in a case of Android or iOS, and two or more APIsets may be provided in a case of Tizen®.

The at least one application 2170 (for example, the applications 147)may include one or more of a home application 2171, a diary application2172, an SMS/multimedia message service (MMS) application 2173, aninstant message (TM) application 2174, a browser application 2175, acamera application 2176, an alarm application 2177, a contactapplication 2178, a voice dial application 2179, an e-mail application2180, a calendar application 2181, a media, player application 2182, analbum application 2183, a clock application 2184, a health careapplication (for example, an application for measuring a work rate orblood sugar) (not shown), and an environmental information application(for example, an application for providing atmospheric pressure,humidity, or temperature information) (not shown).

According to an embodiment, the applications 2170 may include anapplication (hereinafter, referred to as an “information exchangeapplication” for convenience of the description) supporting informationexchange between the electronic device (for example, the electronicdevice 101) and external electronic devices (for example, the electronicdevices 102 and 104). The information exchange application may include,for example, a notification relay application for transmitting specificinformation to the external electronic device, or a device managementapplication for managing the external electronic device.

For example, the notification relay application may include a functionof transferring, to the external electronic device (for example, theelectronic device 102 or 104), notification information generated fromother applications of the electronic device 101 (for example, an SMS/MMSapplication, an e-mail application, a health management application, oran environmental information application). Further, the notificationrelay application may receive notification information from, forexample, the external electronic device and provide the receivednotification information to the user. The device management applicationmay manage (for example, install, delete, or update), for example, afunction for at least a part of the external electronic device (forexample, the electronic device 104) communicating with the electronicdevice (for example, turning on/off the external electronic deviceitself (or some elements thereof) or adjusting brightness (orresolution) of a display), applications executed in the externalelectronic device, or services provided from the external electronicdevice (for example, a telephone call service or a message service).

According to an embodiment, the applications 2170 may include anapplication (for example, health management application) designatedaccording to attributes (for example, attributes of the electronicdevice such as the type of electronic device which corresponds to amobile medical device) of the external electronic device (for example,the electronic device 102 or 104). According to an embodiment, theapplications 2170 may include an application received from the externalelectronic device (for example, the server 106, or the electronic device102 or 104). According to an embodiment, the applications 2170 mayinclude a preloaded application or a third party application that can bedownloaded from the server. Names of the components of the programmodule 2110 according to the above described embodiments may varydepending on the type of operating system.

According to various embodiments, at least some of the programmingmodule 2110 may be implemented in software, firmware, hardware, or acombination of two or more thereof. At least some of the programmingmodule 2110 may be implemented (for example, executed) by, for example,the processor (for example, the AP 2010), At least some of theprogramming module 2110 may include, for example, a module, program,routine, sets of instructions, or process for performing one or morefunctions.

In accordance with an aspect of the present disclosure, amachine-readable storage medium recording a program for executing amethod of processing a content by an electronic device is provided. Themethod includes: generating a content corresponding to a user inputamong one or more contents displayed through a display of the electronicdevice as a first content; and displaying a floating UI, which displaysfirst scrap information on the first content, on a screen.

The term “module” used in the present disclosure may refer to, forexample, a unit including one or more combinations of hardware,software, and firmware. The “module” may be interchangeable with a term,such as a unit, a logic, a logical block, a component, or a circuit. The“module” may be the smallest unit of an integrated component or a partthereof. The “module” may be a mMimum unit for performing one or morefunctions or a part thereof The “module” may be mechanically orelectronically implemented. For example, the “module” according to thepresent disclosure may include at least one of an application-specificintegrated circuit (ASIC) chip, a field-programmable gate arrays (FPGA),and a programmable-logic device for performing operations which has beenknown or are to be developed hereinafter.

According to various embodiments, at least some of the devices (forexample, modules or functions thereof) or the method (for example,operations) according to the present disclosure may be implemented by acommand stored in a computer-readable storage medium in a programmingmodule form. When the command is executed by one or more processors (forexample, the processor 120), the one or more processors may execute afunction corresponding to the command. The computer-readable storagemedium may be, for example, the memory 130.

The computer readable recoding medium may include a hard disk, a floppydisk, magnetic media (e.g., a magnetic tape), optical media (e.g., acompact disc read only memory (CD-ROM) and a digital versatile disc(DVD)), magneto-optical media (e.g., a floptical disk), a hardwaredevice (e.g., a read only memory (ROM), a random access memory (RAM), aflash memory), and the like. In addition, the program instructions mayinclude high class language codes, which can be executed in a computerby using an interpreter, as well as machine codes made by a compiler.The aforementioned hardware device may be configured to operate as oneor more software modules in order to perform the operation of thepresent disclosure, and vice versa.

The programming module according to the present disclosure may includeone or more of the aforementioned components or may further includeother additional components, or some of the aforementioned componentsmay be omitted. Operations executed by a module, a programming module,or other component elements according to various embodiments of thepresent disclosure may be executed sequentially, in parallel,repeatedly, or in a heuristic manner. Further, some operations may beexecuted according to another order or may be omitted, or otheroperations may be added.

While the present disclosure has been shown and described with referenceto various embodiments thereof, it will be understood by those skilledin the art that various changes in form and details may be made thereinwithout departing from the spirit and scope of the present disclosure asdefined by the appended claims and their equivalents.

What is claimed is:
 1. A method for processing contents at an electronicdevice, the method comprising; generating a first content correspondingto a user input applied to content displayed via the electronic device;and displaying a floating user interface (UI), which displays firstscrap information on the first content, on a screen of the electronicdevice.
 2. The method of claim 1, further comprising: generating asecond content; and displaying second scrap information on the firstcontent and the second content through the floating UI.
 3. The method ofclaim 2, wherein displaying the second scrap information comprisesdisplaying a number of contents included in in the first content and anumber of contents included in in the second content.
 4. The method ofclaim 1, wherein displaying the floating UI comprises displaying animage corresponding to the first content through the floating UI.
 5. Themethod of claim 2, further comprising: if a user input on the floatingUI is received, displaying the first content and the second contentsequentially in an order of generation of the contents.
 6. The method ofclaim 1, wherein floating UI is displayed over the one or more contents.7. The method of claim 1, further comprising; determining whether thefirst content includes text; and if the first content includes the text,displaying a menu for providing a text function.
 8. The method of claim1, wherein the text function comprises: extracting the text from thefirst content; and extracting first information related to at least oneof a phone number, a mail, a schedule, a website address, and map datafrom the text.
 9. The method of claim 8, further comprising: displayinga menu for executing a first application related to the firstinformation; and if a user input for the menu is received, executing thefirst application.
 10. The method of claim 2, further comprising:displaying a first image corresponding to the first content and a secondimage corresponding to the second content through the floating UI;receiving a user input for selecting the second image; and if a userinput for sharing content corresponding to the second image is received,transmitting the content corresponding to the second image to acorresponding application or device.
 11. An electronic device forprocessing a content, the electronic device comprising: a display; and aprocessor configured to: generate a first content corresponding to auser input applied to content displayed via the display, and control thedisplay to display a floating user interface (UI), which displays firstscrap information on the first content, on a screen.
 12. The electronicdevice of claim 11, wherein the processor is further configured togenerate a second content and control the display to display secondscrap information on the first content and the second content throughthe floating UI.
 13. The electronic device of claim 12, wherein theprocessor is further configured to control the display to display anumber of contents included in the first content and a number ofcontents included in the second content through the floating UI.
 14. Theelectronic device of claim 11, wherein the processor is furtherconfigured to control the display to display an image corresponding tothe first content through the floating UI.
 15. The electronic device ofclaim 12, wherein the processor is further configured to control thedisplay to display the first content and the second content sequentiallyin an order of generation of the contents when a user input on thefloating UI is received.
 16. The electronic device of claim 11, whereinthe floating UI is displayed over the one or more contents.
 17. Theelectronic device of claim 11, wherein the processor is furtherconfigured to: determine whether the first content includes text, andcontrols the display to display a menu for providing a text function.18. The electronic device of claim 11, wherein the processor is furtherconfigured to extract the text from the first content and extracts firstinformation on a phone number, a mail, a schedule, a website address,and map data from the text.
 19. The electronic device of claim 18,wherein the processor is further configured to control the display todisplay a menu for executing a first application related to the firstinformation, and executes the first application if a user input for themenu is received.
 20. The electronic device of claim 12, wherein theprocessor is further configured to: control the display to: display afirst image corresponding to the first content and a second imagecorresponding to the second content through the floating UI, receive auser input for selecting the second image, and receive a user input forsharing content corresponding to the second image, and transmit thecontent corresponding to the second image to a corresponding applicationor device.
 21. A machine-readable storage medium recording a program forexecuting a method of processing a content at an electronic device, themethod comprising: generating a first content corresponding to a userinput content displayed via the electronic device; and displaying afloating UI, which displays scrap information on the first content, on ascreen of the electronic device.